Epoch 1: avg free-energy loss = 41.1442
Epoch 2: avg free-energy loss = 13.3773
Epoch 3: avg free-energy loss = 9.8521
Epoch 4: avg free-energy loss = 8.0321
Epoch 5: avg free-energy loss = 6.8746
Classifier Epoch 1: loss = 0.5213
Classifier Epoch 2: loss = 0.3976
Classifier Epoch 3: loss = 0.3749
Classifier Epoch 4: loss = 0.3471
Classifier Epoch 5: loss = 0.3272
Test Accuracy: 85.59%
Epoch 1: avg free-energy loss = 51.2651
Epoch 2: avg free-energy loss = 10.8171
Epoch 3: avg free-energy loss = 6.6248
Epoch 4: avg free-energy loss = 4.1506
Epoch 5: avg free-energy loss = 2.7934
Classifier Epoch 1: loss = 0.7158
Classifier Epoch 2: loss = 0.4763
Classifier Epoch 3: loss = 0.4379
Classifier Epoch 4: loss = 0.4142
Classifier Epoch 5: loss = 0.3923
Test Accuracy: 84.56%
Epoch 1: avg free-energy loss = 52.6578
Epoch 2: avg free-energy loss = 11.7883
Epoch 3: avg free-energy loss = 8.3948
Epoch 4: avg free-energy loss = 6.5664
Epoch 5: avg free-energy loss = 5.4403
Classifier Epoch 1: loss = 0.7110
Classifier Epoch 2: loss = 0.4786
Classifier Epoch 3: loss = 0.4406
Classifier Epoch 4: loss = 0.4189
Classifier Epoch 5: loss = 0.3993
Test Accuracy: 84.24%
Epoch 1: avg free-energy loss = 71.9135
Epoch 2: avg free-energy loss = 22.5843
Epoch 3: avg free-energy loss = 17.8595
Epoch 4: avg free-energy loss = 15.3543
Epoch 5: avg free-energy loss = 13.8862
Classifier Epoch 1: loss = 0.5642
Classifier Epoch 2: loss = 0.4330
Classifier Epoch 3: loss = 0.4014
Classifier Epoch 4: loss = 0.3806
Classifier Epoch 5: loss = 0.3607
Test Accuracy: 86.23%
Epoch 1: avg free-energy loss = 92.1053
Epoch 2: avg free-energy loss = 26.7928
Epoch 3: avg free-energy loss = 21.1794
Epoch 4: avg free-energy loss = 18.4277
Epoch 5: avg free-energy loss = 16.8116
Classifier Epoch 1: loss = 0.6061
Classifier Epoch 2: loss = 0.4474
Classifier Epoch 3: loss = 0.4139
Classifier Epoch 4: loss = 0.3952
Classifier Epoch 5: loss = 0.3797
Test Accuracy: 84.67%
Epoch 1: avg free-energy loss = 39.4780
Epoch 2: avg free-energy loss = 10.1831
Epoch 3: avg free-energy loss = 7.9659
Epoch 4: avg free-energy loss = 6.8108
Epoch 5: avg free-energy loss = 5.9059
Classifier Epoch 1: loss = 0.6965
Classifier Epoch 2: loss = 0.4758
Classifier Epoch 3: loss = 0.4419
Classifier Epoch 4: loss = 0.4219
Classifier Epoch 5: loss = 0.4028
Test Accuracy: 84.87%
Epoch 1: avg free-energy loss = 320.9536
Epoch 2: avg free-energy loss = 94.3052
Epoch 3: avg free-energy loss = 61.1653
Epoch 4: avg free-energy loss = 46.2653
Epoch 5: avg free-energy loss = 37.1030
Classifier Epoch 1: loss = 0.6417
Classifier Epoch 2: loss = 0.4454
Classifier Epoch 3: loss = 0.4059
Classifier Epoch 4: loss = 0.3856
Classifier Epoch 5: loss = 0.3706
Test Accuracy: 85.00%
Epoch 1: avg free-energy loss = 403.7881
Epoch 2: avg free-energy loss = 121.6750
Epoch 3: avg free-energy loss = 80.3368
Epoch 4: avg free-energy loss = 59.9126
Epoch 5: avg free-energy loss = 48.5322
Classifier Epoch 1: loss = 0.6895
Classifier Epoch 2: loss = 0.4594
Classifier Epoch 3: loss = 0.4200
Classifier Epoch 4: loss = 0.4043
Classifier Epoch 5: loss = 0.3834
Test Accuracy: 84.73%
Epoch 1: avg free-energy loss = 122.5597
Epoch 2: avg free-energy loss = 35.1586
Epoch 3: avg free-energy loss = 23.1525
Epoch 4: avg free-energy loss = 18.0908
Epoch 5: avg free-energy loss = 15.2489
Classifier Epoch 1: loss = 0.5723
Classifier Epoch 2: loss = 0.4222
Classifier Epoch 3: loss = 0.3881
Classifier Epoch 4: loss = 0.3728
Classifier Epoch 5: loss = 0.3504
Test Accuracy: 86.31%
Epoch 1: avg free-energy loss = 458.6334
Epoch 2: avg free-energy loss = 141.0498
Epoch 3: avg free-energy loss = 93.7296
Epoch 4: avg free-energy loss = 73.0652
Epoch 5: avg free-energy loss = 57.8178
Classifier Epoch 1: loss = 0.6995
Classifier Epoch 2: loss = 0.4669
Classifier Epoch 3: loss = 0.4267
Classifier Epoch 4: loss = 0.4059
Classifier Epoch 5: loss = 0.3906
Test Accuracy: 84.34%
Epoch 1: avg free-energy loss = 164.1483
Epoch 2: avg free-energy loss = 49.9797
Epoch 3: avg free-energy loss = 32.5928
Epoch 4: avg free-energy loss = 25.8441
Epoch 5: avg free-energy loss = 21.1359
Classifier Epoch 1: loss = 0.5876
Classifier Epoch 2: loss = 0.4144
Classifier Epoch 3: loss = 0.3803
Classifier Epoch 4: loss = 0.3544
Classifier Epoch 5: loss = 0.3461
Test Accuracy: 85.65%
Epoch 1: avg free-energy loss = 95.0740
Epoch 2: avg free-energy loss = 26.3020
Epoch 3: avg free-energy loss = 18.8624
Epoch 4: avg free-energy loss = 15.5844
Epoch 5: avg free-energy loss = 13.6336
Classifier Epoch 1: loss = 0.8127
Classifier Epoch 2: loss = 0.5096
Classifier Epoch 3: loss = 0.4621
Classifier Epoch 4: loss = 0.4379
Classifier Epoch 5: loss = 0.4214
Test Accuracy: 83.64%
Epoch 1: avg free-energy loss = 73.6810
Epoch 2: avg free-energy loss = 21.5836
Epoch 3: avg free-energy loss = 16.4904
Epoch 4: avg free-energy loss = 13.9487
Epoch 5: avg free-energy loss = 12.3566
Classifier Epoch 1: loss = 0.5974
Classifier Epoch 2: loss = 0.4405
Classifier Epoch 3: loss = 0.4066
Classifier Epoch 4: loss = 0.3740
Classifier Epoch 5: loss = 0.3622
Test Accuracy: 85.38%
Epoch 1: avg free-energy loss = 169.3721
Epoch 2: avg free-energy loss = 46.9003
Epoch 3: avg free-energy loss = 30.8309
Epoch 4: avg free-energy loss = 24.8842
Epoch 5: avg free-energy loss = 21.0956
Classifier Epoch 1: loss = 0.6443
Classifier Epoch 2: loss = 0.4552
Classifier Epoch 3: loss = 0.4188
Classifier Epoch 4: loss = 0.3990
Classifier Epoch 5: loss = 0.3846
Test Accuracy: 84.76%
Epoch 1: avg free-energy loss = -10.3921
Epoch 2: avg free-energy loss = -10.1069
Epoch 3: avg free-energy loss = -8.4857
Epoch 4: avg free-energy loss = -7.2676
Epoch 5: avg free-energy loss = -6.2592
Classifier Epoch 1: loss = 0.5580
Classifier Epoch 2: loss = 0.4209
Classifier Epoch 3: loss = 0.3892
Classifier Epoch 4: loss = 0.3672
Classifier Epoch 5: loss = 0.3519
Test Accuracy: 85.51%
Epoch 1: avg free-energy loss = 89.0311
Epoch 2: avg free-energy loss = 23.6226
Epoch 3: avg free-energy loss = 15.7039
Epoch 4: avg free-energy loss = 12.2822
Epoch 5: avg free-energy loss = 10.4378
Classifier Epoch 1: loss = 0.5935
Classifier Epoch 2: loss = 0.4254
Classifier Epoch 3: loss = 0.3960
Classifier Epoch 4: loss = 0.3748
Classifier Epoch 5: loss = 0.3591
Test Accuracy: 86.27%
Epoch 1: avg free-energy loss = 105.0794
Epoch 2: avg free-energy loss = 27.8303
Epoch 3: avg free-energy loss = 18.1141
Epoch 4: avg free-energy loss = 14.2598
Epoch 5: avg free-energy loss = 11.7045
Classifier Epoch 1: loss = 0.5736
Classifier Epoch 2: loss = 0.4233
Classifier Epoch 3: loss = 0.3886
Classifier Epoch 4: loss = 0.3585
Classifier Epoch 5: loss = 0.3408
Test Accuracy: 85.99%
Epoch 1: avg free-energy loss = -9.4493
Epoch 2: avg free-energy loss = -11.3147
Epoch 3: avg free-energy loss = -10.1384
Epoch 4: avg free-energy loss = -9.1680
Epoch 5: avg free-energy loss = -8.1800
Classifier Epoch 1: loss = 0.6607
Classifier Epoch 2: loss = 0.4645
Classifier Epoch 3: loss = 0.4321
Classifier Epoch 4: loss = 0.4088
Classifier Epoch 5: loss = 0.3891
Test Accuracy: 84.13%
Epoch 1: avg free-energy loss = 112.3624
Epoch 2: avg free-energy loss = 31.7360
Epoch 3: avg free-energy loss = 20.3989
Epoch 4: avg free-energy loss = 15.3285
Epoch 5: avg free-energy loss = 12.7928
Classifier Epoch 1: loss = 0.6094
Classifier Epoch 2: loss = 0.4393
Classifier Epoch 3: loss = 0.4008
Classifier Epoch 4: loss = 0.3739
Classifier Epoch 5: loss = 0.3602
Test Accuracy: 85.91%
Epoch 1: avg free-energy loss = 241.7577
Epoch 2: avg free-energy loss = 78.0329
Epoch 3: avg free-energy loss = 52.1741
Epoch 4: avg free-energy loss = 37.2763
Epoch 5: avg free-energy loss = 31.4904
Classifier Epoch 1: loss = 0.6753
Classifier Epoch 2: loss = 0.4577
Classifier Epoch 3: loss = 0.4233
Classifier Epoch 4: loss = 0.3942
Classifier Epoch 5: loss = 0.3824
Test Accuracy: 85.65%
Epoch 1: avg free-energy loss = 80.2170
Epoch 2: avg free-energy loss = 21.9503
Epoch 3: avg free-energy loss = 15.2571
Epoch 4: avg free-energy loss = 11.8656
Epoch 5: avg free-energy loss = 10.0759
Classifier Epoch 1: loss = 0.6182
Classifier Epoch 2: loss = 0.4349
Classifier Epoch 3: loss = 0.4019
Classifier Epoch 4: loss = 0.3788
Classifier Epoch 5: loss = 0.3646
Test Accuracy: 86.09%
Epoch 1: avg free-energy loss = 95.1577
Epoch 2: avg free-energy loss = 26.6906
Epoch 3: avg free-energy loss = 19.8070
Epoch 4: avg free-energy loss = 16.7382
Epoch 5: avg free-energy loss = 14.8592
Classifier Epoch 1: loss = 0.5755
Classifier Epoch 2: loss = 0.4317
Classifier Epoch 3: loss = 0.4003
Classifier Epoch 4: loss = 0.3777
Classifier Epoch 5: loss = 0.3587
Test Accuracy: 86.58%
Epoch 1: avg free-energy loss = 151.1207
Epoch 2: avg free-energy loss = 37.0672
Epoch 3: avg free-energy loss = 26.0086
Epoch 4: avg free-energy loss = 20.5716
Epoch 5: avg free-energy loss = 17.5519
Classifier Epoch 1: loss = 0.5953
Classifier Epoch 2: loss = 0.4474
Classifier Epoch 3: loss = 0.4130
Classifier Epoch 4: loss = 0.3876
Classifier Epoch 5: loss = 0.3727
Test Accuracy: 86.07%
Epoch 1: avg free-energy loss = 125.3522
Epoch 2: avg free-energy loss = 36.8164
Epoch 3: avg free-energy loss = 25.2092
Epoch 4: avg free-energy loss = 20.3698
Epoch 5: avg free-energy loss = 17.6231
Classifier Epoch 1: loss = 0.5703
Classifier Epoch 2: loss = 0.4260
Classifier Epoch 3: loss = 0.3856
Classifier Epoch 4: loss = 0.3651
Classifier Epoch 5: loss = 0.3507
Test Accuracy: 86.00%
Epoch 1: avg free-energy loss = 114.6826
Epoch 2: avg free-energy loss = 53.7552
Epoch 3: avg free-energy loss = 26.0180
Epoch 4: avg free-energy loss = 22.9473
Epoch 5: avg free-energy loss = 21.3614
Classifier Epoch 1: loss = 0.6536
Classifier Epoch 2: loss = 0.4553
Classifier Epoch 3: loss = 0.4137
Classifier Epoch 4: loss = 0.4054
Classifier Epoch 5: loss = 0.3769
Test Accuracy: 82.07%
Epoch 1: avg free-energy loss = 48.3332
Epoch 2: avg free-energy loss = 14.7865
Epoch 3: avg free-energy loss = 11.0317
Epoch 4: avg free-energy loss = 9.3471
Epoch 5: avg free-energy loss = 8.3662
Classifier Epoch 1: loss = 0.5790
Classifier Epoch 2: loss = 0.4320
Classifier Epoch 3: loss = 0.4038
Classifier Epoch 4: loss = 0.3767
Classifier Epoch 5: loss = 0.3553
Test Accuracy: 86.19%
Epoch 1: avg free-energy loss = 17.3310
Epoch 2: avg free-energy loss = 1.5393
Epoch 3: avg free-energy loss = 0.1846
Epoch 4: avg free-energy loss = -0.2184
Epoch 5: avg free-energy loss = -0.5774
Classifier Epoch 1: loss = 0.6372
Classifier Epoch 2: loss = 0.4535
Classifier Epoch 3: loss = 0.4209
Classifier Epoch 4: loss = 0.3994
Classifier Epoch 5: loss = 0.3779
Test Accuracy: 84.84%
Epoch 1: avg free-energy loss = 140.1578
Epoch 2: avg free-energy loss = 37.5575
Epoch 3: avg free-energy loss = 24.7901
Epoch 4: avg free-energy loss = 19.1708
Epoch 5: avg free-energy loss = 15.9026
Classifier Epoch 1: loss = 0.6525
Classifier Epoch 2: loss = 0.4436
Classifier Epoch 3: loss = 0.4111
Classifier Epoch 4: loss = 0.3894
Classifier Epoch 5: loss = 0.3749
Test Accuracy: 84.82%
Epoch 1: avg free-energy loss = 145.5177
Epoch 2: avg free-energy loss = 43.2769
Epoch 3: avg free-energy loss = 30.1405
Epoch 4: avg free-energy loss = 24.0759
Epoch 5: avg free-energy loss = 20.5072
Classifier Epoch 1: loss = 0.5314
Classifier Epoch 2: loss = 0.4079
Classifier Epoch 3: loss = 0.3772
Classifier Epoch 4: loss = 0.3566
Classifier Epoch 5: loss = 0.3346
Test Accuracy: 86.54%
Epoch 1: avg free-energy loss = 139.6170
Epoch 2: avg free-energy loss = 41.2337
Epoch 3: avg free-energy loss = 28.9471
Epoch 4: avg free-energy loss = 23.2911
Epoch 5: avg free-energy loss = 19.7793
Classifier Epoch 1: loss = 0.5359
Classifier Epoch 2: loss = 0.4040
Classifier Epoch 3: loss = 0.3739
Classifier Epoch 4: loss = 0.3533
Classifier Epoch 5: loss = 0.3370
Test Accuracy: 85.48%
Epoch 1: avg free-energy loss = 155.9953
Epoch 2: avg free-energy loss = 44.8035
Epoch 3: avg free-energy loss = 31.5432
Epoch 4: avg free-energy loss = 25.7398
Epoch 5: avg free-energy loss = 22.2983
Classifier Epoch 1: loss = 0.5411
Classifier Epoch 2: loss = 0.4138
Classifier Epoch 3: loss = 0.3856
Classifier Epoch 4: loss = 0.3583
Classifier Epoch 5: loss = 0.3411
Test Accuracy: 86.32%
Epoch 1: avg free-energy loss = 153.2852
Epoch 2: avg free-energy loss = 45.7144
Epoch 3: avg free-energy loss = 32.1552
Epoch 4: avg free-energy loss = 26.3964
Epoch 5: avg free-energy loss = 23.1470
Classifier Epoch 1: loss = 0.5518
Classifier Epoch 2: loss = 0.4154
Classifier Epoch 3: loss = 0.3849
Classifier Epoch 4: loss = 0.3604
Classifier Epoch 5: loss = 0.3449
Test Accuracy: 85.75%
Epoch 1: avg free-energy loss = 144.0413
Epoch 2: avg free-energy loss = 37.8745
Epoch 3: avg free-energy loss = 28.1547
Epoch 4: avg free-energy loss = 23.8362
Epoch 5: avg free-energy loss = 21.1103
Classifier Epoch 1: loss = 0.5451
Classifier Epoch 2: loss = 0.4218
Classifier Epoch 3: loss = 0.3893
Classifier Epoch 4: loss = 0.3644
Classifier Epoch 5: loss = 0.3597
Test Accuracy: 85.55%
Epoch 1: avg free-energy loss = 122.0357
Epoch 2: avg free-energy loss = 32.5872
Epoch 3: avg free-energy loss = 23.8392
Epoch 4: avg free-energy loss = 20.4337
Epoch 5: avg free-energy loss = 18.0269
Classifier Epoch 1: loss = 0.6001
Classifier Epoch 2: loss = 0.4407
Classifier Epoch 3: loss = 0.4051
Classifier Epoch 4: loss = 0.3717
Classifier Epoch 5: loss = 0.3566
Test Accuracy: 85.01%
Epoch 1: avg free-energy loss = 146.0580
Epoch 2: avg free-energy loss = 43.7938
Epoch 3: avg free-energy loss = 31.2302
Epoch 4: avg free-energy loss = 24.6140
Epoch 5: avg free-energy loss = 21.3218
Classifier Epoch 1: loss = 0.5395
Classifier Epoch 2: loss = 0.4114
Classifier Epoch 3: loss = 0.3776
Classifier Epoch 4: loss = 0.3592
Classifier Epoch 5: loss = 0.3371
Test Accuracy: 86.11%
Epoch 1: avg free-energy loss = 203.7523
Epoch 2: avg free-energy loss = 56.8096
Epoch 3: avg free-energy loss = 38.0626
Epoch 4: avg free-energy loss = 30.4193
Epoch 5: avg free-energy loss = 24.9903
Classifier Epoch 1: loss = 0.5848
Classifier Epoch 2: loss = 0.4187
Classifier Epoch 3: loss = 0.3854
Classifier Epoch 4: loss = 0.3586
Classifier Epoch 5: loss = 0.3502
Test Accuracy: 86.05%
Epoch 1: avg free-energy loss = 57.5091
Epoch 2: avg free-energy loss = 20.7694
Epoch 3: avg free-energy loss = 16.6623
Epoch 4: avg free-energy loss = 14.8152
Epoch 5: avg free-energy loss = 13.4973
Classifier Epoch 1: loss = 0.5423
Classifier Epoch 2: loss = 0.4187
Classifier Epoch 3: loss = 0.3846
Classifier Epoch 4: loss = 0.3643
Classifier Epoch 5: loss = 0.3521
Test Accuracy: 85.45%
Epoch 1: avg free-energy loss = 143.3145
Epoch 2: avg free-energy loss = 33.9704
Epoch 3: avg free-energy loss = 23.6725
Epoch 4: avg free-energy loss = 19.3836
Epoch 5: avg free-energy loss = 16.5939
Classifier Epoch 1: loss = 0.6145
Classifier Epoch 2: loss = 0.4406
Classifier Epoch 3: loss = 0.4070
Classifier Epoch 4: loss = 0.3769
Classifier Epoch 5: loss = 0.3651
Test Accuracy: 85.65%
Epoch 1: avg free-energy loss = 256.5661
Epoch 2: avg free-energy loss = 59.7481
Epoch 3: avg free-energy loss = 35.7942
Epoch 4: avg free-energy loss = 25.1669
Epoch 5: avg free-energy loss = 20.8809
Classifier Epoch 1: loss = 0.7320
Classifier Epoch 2: loss = 0.4937
Classifier Epoch 3: loss = 0.4554
Classifier Epoch 4: loss = 0.4339
Classifier Epoch 5: loss = 0.4185
Test Accuracy: 84.15%
Epoch 1: avg free-energy loss = 122.4898
Epoch 2: avg free-energy loss = 34.5530
Epoch 3: avg free-energy loss = 24.5251
Epoch 4: avg free-energy loss = 20.6756
Epoch 5: avg free-energy loss = 18.4158
Classifier Epoch 1: loss = 0.5601
Classifier Epoch 2: loss = 0.4250
Classifier Epoch 3: loss = 0.3860
Classifier Epoch 4: loss = 0.3633
Classifier Epoch 5: loss = 0.3520
Test Accuracy: 86.29%
Epoch 1: avg free-energy loss = 126.8193
Epoch 2: avg free-energy loss = 37.0817
Epoch 3: avg free-energy loss = 25.9812
Epoch 4: avg free-energy loss = 20.9937
Epoch 5: avg free-energy loss = 17.9932
Classifier Epoch 1: loss = 0.5466
Classifier Epoch 2: loss = 0.4123
Classifier Epoch 3: loss = 0.3767
Classifier Epoch 4: loss = 0.3582
Classifier Epoch 5: loss = 0.3445
Test Accuracy: 85.55%
Epoch 1: avg free-energy loss = 138.7841
Epoch 2: avg free-energy loss = 39.0252
Epoch 3: avg free-energy loss = 26.9802
Epoch 4: avg free-energy loss = 21.7643
Epoch 5: avg free-energy loss = 18.6815
Classifier Epoch 1: loss = 0.5636
Classifier Epoch 2: loss = 0.4298
Classifier Epoch 3: loss = 0.3867
Classifier Epoch 4: loss = 0.3638
Classifier Epoch 5: loss = 0.3481
Test Accuracy: 86.50%
Epoch 1: avg free-energy loss = 154.5159
Epoch 2: avg free-energy loss = 43.7947
Epoch 3: avg free-energy loss = 31.7493
Epoch 4: avg free-energy loss = 26.3149
Epoch 5: avg free-energy loss = 22.8085
Classifier Epoch 1: loss = 0.5366
Classifier Epoch 2: loss = 0.4173
Classifier Epoch 3: loss = 0.3788
Classifier Epoch 4: loss = 0.3599
Classifier Epoch 5: loss = 0.3422
Test Accuracy: 86.66%
Epoch 1: avg free-energy loss = 146.4180
Epoch 2: avg free-energy loss = 41.2446
Epoch 3: avg free-energy loss = 29.6270
Epoch 4: avg free-energy loss = 24.5179
Epoch 5: avg free-energy loss = 21.2968
Classifier Epoch 1: loss = 0.5587
Classifier Epoch 2: loss = 0.4224
Classifier Epoch 3: loss = 0.3826
Classifier Epoch 4: loss = 0.3593
Classifier Epoch 5: loss = 0.3474
Test Accuracy: 86.22%
Epoch 1: avg free-energy loss = 153.0604
Epoch 2: avg free-energy loss = 38.7216
Epoch 3: avg free-energy loss = 28.1554
Epoch 4: avg free-energy loss = 23.6256
Epoch 5: avg free-energy loss = 21.2592
Classifier Epoch 1: loss = 0.5506
Classifier Epoch 2: loss = 0.4208
Classifier Epoch 3: loss = 0.3897
Classifier Epoch 4: loss = 0.3720
Classifier Epoch 5: loss = 0.3518
Test Accuracy: 84.84%
Epoch 1: avg free-energy loss = 166.1443
Epoch 2: avg free-energy loss = 46.4790
Epoch 3: avg free-energy loss = 32.0942
Epoch 4: avg free-energy loss = 26.2845
Epoch 5: avg free-energy loss = 22.5830
Classifier Epoch 1: loss = 0.5713
Classifier Epoch 2: loss = 0.4153
Classifier Epoch 3: loss = 0.3843
Classifier Epoch 4: loss = 0.3637
Classifier Epoch 5: loss = 0.3435
Test Accuracy: 86.77%
Epoch 1: avg free-energy loss = 217.4522
Epoch 2: avg free-energy loss = 56.0750
Epoch 3: avg free-energy loss = 37.5405
Epoch 4: avg free-energy loss = 28.9540
Epoch 5: avg free-energy loss = 26.0145
Classifier Epoch 1: loss = 0.6269
Classifier Epoch 2: loss = 0.4323
Classifier Epoch 3: loss = 0.3935
Classifier Epoch 4: loss = 0.3625
Classifier Epoch 5: loss = 0.3469
Test Accuracy: 86.54%
Epoch 1: avg free-energy loss = 208.8774
Epoch 2: avg free-energy loss = 54.9503
Epoch 3: avg free-energy loss = 38.0580
Epoch 4: avg free-energy loss = 29.2487
Epoch 5: avg free-energy loss = 24.2918
Classifier Epoch 1: loss = 0.6660
Classifier Epoch 2: loss = 0.4332
Classifier Epoch 3: loss = 0.4066
Classifier Epoch 4: loss = 0.3764
Classifier Epoch 5: loss = 0.3647
Test Accuracy: 84.84%
Epoch 1: avg free-energy loss = 204.2048
Epoch 2: avg free-energy loss = 57.3754
Epoch 3: avg free-energy loss = 39.3723
Epoch 4: avg free-energy loss = 32.0937
Epoch 5: avg free-energy loss = 27.4903
Classifier Epoch 1: loss = 0.5816
Classifier Epoch 2: loss = 0.4200
Classifier Epoch 3: loss = 0.3822
Classifier Epoch 4: loss = 0.3646
Classifier Epoch 5: loss = 0.3438
Test Accuracy: 83.88%
Epoch 1: avg free-energy loss = 267.3551
Epoch 2: avg free-energy loss = 65.9227
Epoch 3: avg free-energy loss = 42.0068
Epoch 4: avg free-energy loss = 33.0611
Epoch 5: avg free-energy loss = 26.3194
Classifier Epoch 1: loss = 0.7123
Classifier Epoch 2: loss = 0.4635
Classifier Epoch 3: loss = 0.4277
Classifier Epoch 4: loss = 0.3987
Classifier Epoch 5: loss = 0.3845
Test Accuracy: 84.89%
{'num_rbm_epochs': 5, 'batch_size': 244, 'rbm_lr': 0.07049262688811203, 'rbm_hidden': 7387, 'fnn_hidden': 245, 'fnn_lr': 0.0018524990979230458, 'num_classifier_epochs': 5}
86.77
FrozenTrial(number=45, state=1, values=[86.77], datetime_start=datetime.datetime(2025, 3, 16, 10, 47, 30, 685079), datetime_complete=datetime.datetime(2025, 3, 16, 10, 48, 19, 119008), params={'num_rbm_epochs': 5, 'batch_size': 244, 'rbm_lr': 0.07049262688811203, 'rbm_hidden': 7387, 'fnn_hidden': 245, 'fnn_lr': 0.0018524990979230458, 'num_classifier_epochs': 5}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'num_rbm_epochs': IntDistribution(high=5, log=False, low=5, step=1), 'batch_size': IntDistribution(high=1024, log=False, low=192, step=1), 'rbm_lr': FloatDistribution(high=0.1, log=False, low=0.05, step=None), 'rbm_hidden': IntDistribution(high=8192, log=False, low=384, step=1), 'fnn_hidden': IntDistribution(high=384, log=False, low=192, step=1), 'fnn_lr': FloatDistribution(high=0.0025, log=False, low=0.0001, step=None), 'num_classifier_epochs': IntDistribution(high=5, log=False, low=5, step=1)}, trial_id=45, value=None)
[I 2025-03-16 10:20:17,231] A new study created in memory with name: no-name-3fd60331-c125-44cc-a73c-619d366ba06b
[I 2025-03-16 10:20:49,479] Trial 0 finished with value: 85.59 and parameters: {'num_rbm_epochs': 5, 'batch_size': 198, 'rbm_lr': 0.08436361841264595, 'rbm_hidden': 2604, 'fnn_hidden': 306, 'fnn_lr': 0.0010838070161156045, 'num_classifier_epochs': 5}. Best is trial 0 with value: 85.59.
[I 2025-03-16 10:21:10,089] Trial 1 finished with value: 84.56 and parameters: {'num_rbm_epochs': 5, 'batch_size': 991, 'rbm_lr': 0.09517929706969339, 'rbm_hidden': 1810, 'fnn_hidden': 296, 'fnn_lr': 0.0015792763243647335, 'num_classifier_epochs': 5}. Best is trial 0 with value: 85.59.
[I 2025-03-16 10:21:32,289] Trial 2 finished with value: 84.24 and parameters: {'num_rbm_epochs': 5, 'batch_size': 748, 'rbm_lr': 0.06911001243709392, 'rbm_hidden': 2118, 'fnn_hidden': 323, 'fnn_lr': 0.0007756834698615648, 'num_classifier_epochs': 5}. Best is trial 0 with value: 85.59.
[I 2025-03-16 10:22:09,369] Trial 3 finished with value: 86.23 and parameters: {'num_rbm_epochs': 5, 'batch_size': 263, 'rbm_lr': 0.058190166539460526, 'rbm_hidden': 4239, 'fnn_hidden': 281, 'fnn_lr': 0.0007267706569254254, 'num_classifier_epochs': 5}. Best is trial 3 with value: 86.23.
[I 2025-03-16 10:23:00,353] Trial 4 finished with value: 84.67 and parameters: {'num_rbm_epochs': 5, 'batch_size': 195, 'rbm_lr': 0.0565270769168038, 'rbm_hidden': 6573, 'fnn_hidden': 316, 'fnn_lr': 0.0002515160235790303, 'num_classifier_epochs': 5}. Best is trial 3 with value: 86.23.
[I 2025-03-16 10:23:23,385] Trial 5 finished with value: 84.87 and parameters: {'num_rbm_epochs': 5, 'batch_size': 583, 'rbm_lr': 0.0569694283986999, 'rbm_hidden': 2234, 'fnn_hidden': 218, 'fnn_lr': 0.0007239785815181317, 'num_classifier_epochs': 5}. Best is trial 3 with value: 86.23.
[I 2025-03-16 10:23:58,830] Trial 6 finished with value: 85.0 and parameters: {'num_rbm_epochs': 5, 'batch_size': 660, 'rbm_lr': 0.09784453071169795, 'rbm_hidden': 6315, 'fnn_hidden': 196, 'fnn_lr': 0.0013277043439209935, 'num_classifier_epochs': 5}. Best is trial 3 with value: 86.23.
[I 2025-03-16 10:24:38,929] Trial 7 finished with value: 84.73 and parameters: {'num_rbm_epochs': 5, 'batch_size': 712, 'rbm_lr': 0.08371648875951856, 'rbm_hidden': 8022, 'fnn_hidden': 205, 'fnn_lr': 0.0010409495649736215, 'num_classifier_epochs': 5}. Best is trial 3 with value: 86.23.
[I 2025-03-16 10:25:12,672] Trial 8 finished with value: 86.31 and parameters: {'num_rbm_epochs': 5, 'batch_size': 354, 'rbm_lr': 0.09386436120135674, 'rbm_hidden': 4225, 'fnn_hidden': 332, 'fnn_lr': 0.0008725880811642252, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:25:49,481] Trial 9 finished with value: 84.34 and parameters: {'num_rbm_epochs': 5, 'batch_size': 903, 'rbm_lr': 0.09747372730224671, 'rbm_hidden': 7322, 'fnn_hidden': 379, 'fnn_lr': 0.0006322895096422124, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:26:23,823] Trial 10 finished with value: 85.65 and parameters: {'num_rbm_epochs': 5, 'batch_size': 416, 'rbm_lr': 0.08435961483147174, 'rbm_hidden': 5015, 'fnn_hidden': 372, 'fnn_lr': 0.0023431164249826976, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:26:55,652] Trial 11 finished with value: 83.64 and parameters: {'num_rbm_epochs': 5, 'batch_size': 381, 'rbm_lr': 0.06780291233740607, 'rbm_hidden': 3975, 'fnn_hidden': 251, 'fnn_lr': 0.00016446063288698344, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:27:27,860] Trial 12 finished with value: 85.38 and parameters: {'num_rbm_epochs': 5, 'batch_size': 375, 'rbm_lr': 0.05093322085424206, 'rbm_hidden': 4147, 'fnn_hidden': 268, 'fnn_lr': 0.0016396985845204568, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:28:01,511] Trial 13 finished with value: 84.76 and parameters: {'num_rbm_epochs': 5, 'batch_size': 507, 'rbm_lr': 0.07077828351725873, 'rbm_hidden': 5262, 'fnn_hidden': 345, 'fnn_lr': 0.0004785954470162955, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:28:24,865] Trial 14 finished with value: 85.51 and parameters: {'num_rbm_epochs': 5, 'batch_size': 281, 'rbm_lr': 0.07775633712632858, 'rbm_hidden': 795, 'fnn_hidden': 268, 'fnn_lr': 0.0021710908045704095, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:28:52,409] Trial 15 finished with value: 86.27 and parameters: {'num_rbm_epochs': 5, 'batch_size': 482, 'rbm_lr': 0.0895957246599477, 'rbm_hidden': 3085, 'fnn_hidden': 344, 'fnn_lr': 0.0010268309089367538, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:29:20,142] Trial 16 finished with value: 85.99 and parameters: {'num_rbm_epochs': 5, 'batch_size': 510, 'rbm_lr': 0.09002179358375789, 'rbm_hidden': 3294, 'fnn_hidden': 345, 'fnn_lr': 0.001811044928710925, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:29:41,024] Trial 17 finished with value: 84.13 and parameters: {'num_rbm_epochs': 5, 'batch_size': 478, 'rbm_lr': 0.08961842166824682, 'rbm_hidden': 813, 'fnn_hidden': 345, 'fnn_lr': 0.0011408148875530226, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:30:08,653] Trial 18 finished with value: 85.91 and parameters: {'num_rbm_epochs': 5, 'batch_size': 580, 'rbm_lr': 0.09166284032750835, 'rbm_hidden': 3297, 'fnn_hidden': 360, 'fnn_lr': 0.0014032099604874364, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:30:39,262] Trial 19 finished with value: 85.65 and parameters: {'num_rbm_epochs': 5, 'batch_size': 813, 'rbm_lr': 0.07770916211142298, 'rbm_hidden': 5240, 'fnn_hidden': 328, 'fnn_lr': 0.0009404346428016813, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:31:10,839] Trial 20 finished with value: 86.09 and parameters: {'num_rbm_epochs': 5, 'batch_size': 307, 'rbm_lr': 0.09276556866747745, 'rbm_hidden': 3357, 'fnn_hidden': 361, 'fnn_lr': 0.0004192078330751662, 'num_classifier_epochs': 5}. Best is trial 8 with value: 86.31.
[I 2025-03-16 10:31:45,511] Trial 21 finished with value: 86.58 and parameters: {'num_rbm_epochs': 5, 'batch_size': 300, 'rbm_lr': 0.0630845145868285, 'rbm_hidden': 4615, 'fnn_hidden': 283, 'fnn_lr': 0.0008912603968912184, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:32:23,039] Trial 22 finished with value: 86.07 and parameters: {'num_rbm_epochs': 5, 'batch_size': 421, 'rbm_lr': 0.06251654781962593, 'rbm_hidden': 5929, 'fnn_hidden': 245, 'fnn_lr': 0.000895944266287479, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:32:58,420] Trial 23 finished with value: 86.0 and parameters: {'num_rbm_epochs': 5, 'batch_size': 358, 'rbm_lr': 0.07427774583445655, 'rbm_hidden': 4726, 'fnn_hidden': 293, 'fnn_lr': 0.0012703888693112663, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:33:29,227] Trial 24 finished with value: 82.07 and parameters: {'num_rbm_epochs': 5, 'batch_size': 458, 'rbm_lr': 0.08614515411514082, 'rbm_hidden': 3727, 'fnn_hidden': 331, 'fnn_lr': 0.0005636603373389042, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:33:57,719] Trial 25 finished with value: 86.19 and parameters: {'num_rbm_epochs': 5, 'batch_size': 317, 'rbm_lr': 0.06426045482874108, 'rbm_hidden': 2756, 'fnn_hidden': 309, 'fnn_lr': 0.0008644664525628772, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:34:20,258] Trial 26 finished with value: 84.84 and parameters: {'num_rbm_epochs': 5, 'batch_size': 528, 'rbm_lr': 0.07852501111686691, 'rbm_hidden': 1490, 'fnn_hidden': 280, 'fnn_lr': 0.0011880189983864418, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:34:57,279] Trial 27 finished with value: 84.82 and parameters: {'num_rbm_epochs': 5, 'batch_size': 331, 'rbm_lr': 0.09951089419898172, 'rbm_hidden': 4612, 'fnn_hidden': 334, 'fnn_lr': 0.0003662483925512541, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:35:41,208] Trial 28 finished with value: 86.54 and parameters: {'num_rbm_epochs': 5, 'batch_size': 246, 'rbm_lr': 0.0806928992542019, 'rbm_hidden': 5818, 'fnn_hidden': 239, 'fnn_lr': 0.001421823379732054, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:36:22,697] Trial 29 finished with value: 85.48 and parameters: {'num_rbm_epochs': 5, 'batch_size': 240, 'rbm_lr': 0.08191693085219776, 'rbm_hidden': 5617, 'fnn_hidden': 233, 'fnn_lr': 0.0019379554904379302, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:37:12,847] Trial 30 finished with value: 86.32 and parameters: {'num_rbm_epochs': 5, 'batch_size': 232, 'rbm_lr': 0.0725829489456351, 'rbm_hidden': 6926, 'fnn_hidden': 258, 'fnn_lr': 0.0015406539690326852, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:38:03,831] Trial 31 finished with value: 85.75 and parameters: {'num_rbm_epochs': 5, 'batch_size': 231, 'rbm_lr': 0.07193216348130695, 'rbm_hidden': 6994, 'fnn_hidden': 257, 'fnn_lr': 0.0015120602262159544, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:38:57,382] Trial 32 finished with value: 85.55 and parameters: {'num_rbm_epochs': 5, 'batch_size': 209, 'rbm_lr': 0.06591528376492337, 'rbm_hidden': 7650, 'fnn_hidden': 233, 'fnn_lr': 0.0017625116122405467, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:39:41,544] Trial 33 finished with value: 85.01 and parameters: {'num_rbm_epochs': 5, 'batch_size': 279, 'rbm_lr': 0.061660943458468176, 'rbm_hidden': 6305, 'fnn_hidden': 304, 'fnn_lr': 0.0015334078426596813, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:40:24,190] Trial 34 finished with value: 86.11 and parameters: {'num_rbm_epochs': 5, 'batch_size': 265, 'rbm_lr': 0.08150999528526993, 'rbm_hidden': 5708, 'fnn_hidden': 270, 'fnn_lr': 0.0014069792125121856, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:41:08,016] Trial 35 finished with value: 86.05 and parameters: {'num_rbm_epochs': 5, 'batch_size': 342, 'rbm_lr': 0.07499363389043588, 'rbm_hidden': 6954, 'fnn_hidden': 236, 'fnn_lr': 0.002065296507974171, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:41:48,220] Trial 36 finished with value: 85.45 and parameters: {'num_rbm_epochs': 5, 'batch_size': 197, 'rbm_lr': 0.05099482278381415, 'rbm_hidden': 4463, 'fnn_hidden': 218, 'fnn_lr': 0.0011903289979520082, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:42:27,891] Trial 37 finished with value: 85.65 and parameters: {'num_rbm_epochs': 5, 'batch_size': 409, 'rbm_lr': 0.0598297576776619, 'rbm_hidden': 6119, 'fnn_hidden': 285, 'fnn_lr': 0.0017097004725772566, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:43:01,412] Trial 38 finished with value: 84.15 and parameters: {'num_rbm_epochs': 5, 'batch_size': 1003, 'rbm_lr': 0.05501072657712741, 'rbm_hidden': 6582, 'fnn_hidden': 297, 'fnn_lr': 0.0007606774422401882, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:43:39,369] Trial 39 finished with value: 86.29 and parameters: {'num_rbm_epochs': 5, 'batch_size': 298, 'rbm_lr': 0.06851065965858913, 'rbm_hidden': 5463, 'fnn_hidden': 255, 'fnn_lr': 0.001314444709107097, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:44:18,404] Trial 40 finished with value: 85.55 and parameters: {'num_rbm_epochs': 5, 'batch_size': 266, 'rbm_lr': 0.08653710281047691, 'rbm_hidden': 4903, 'fnn_hidden': 222, 'fnn_lr': 0.001018827542451288, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:44:55,710] Trial 41 finished with value: 86.5 and parameters: {'num_rbm_epochs': 5, 'batch_size': 320, 'rbm_lr': 0.0710162975322479, 'rbm_hidden': 5465, 'fnn_hidden': 258, 'fnn_lr': 0.0013374761899341667, 'num_classifier_epochs': 5}. Best is trial 21 with value: 86.58.
[I 2025-03-16 10:45:44,207] Trial 42 finished with value: 86.66 and parameters: {'num_rbm_epochs': 5, 'batch_size': 238, 'rbm_lr': 0.0724841516298329, 'rbm_hidden': 6840, 'fnn_hidden': 276, 'fnn_lr': 0.0013355808077534668, 'num_classifier_epochs': 5}. Best is trial 42 with value: 86.66.
[I 2025-03-16 10:46:33,191] Trial 43 finished with value: 86.22 and parameters: {'num_rbm_epochs': 5, 'batch_size': 227, 'rbm_lr': 0.07235856124118478, 'rbm_hidden': 6713, 'fnn_hidden': 273, 'fnn_lr': 0.001415057840328747, 'num_classifier_epochs': 5}. Best is trial 42 with value: 86.66.
[I 2025-03-16 10:47:30,684] Trial 44 finished with value: 84.84 and parameters: {'num_rbm_epochs': 5, 'batch_size': 201, 'rbm_lr': 0.06663060375579816, 'rbm_hidden': 8168, 'fnn_hidden': 259, 'fnn_lr': 0.0016068131480314921, 'num_classifier_epochs': 5}. Best is trial 42 with value: 86.66.
[I 2025-03-16 10:48:19,119] Trial 45 finished with value: 86.77 and parameters: {'num_rbm_epochs': 5, 'batch_size': 244, 'rbm_lr': 0.07049262688811203, 'rbm_hidden': 7387, 'fnn_hidden': 245, 'fnn_lr': 0.0018524990979230458, 'num_classifier_epochs': 5}. Best is trial 45 with value: 86.77.
[I 2025-03-16 10:49:03,522] Trial 46 finished with value: 86.54 and parameters: {'num_rbm_epochs': 5, 'batch_size': 380, 'rbm_lr': 0.0704344682782717, 'rbm_hidden': 7530, 'fnn_hidden': 242, 'fnn_lr': 0.002498329803237352, 'num_classifier_epochs': 5}. Best is trial 45 with value: 86.77.
[I 2025-03-16 10:49:46,358] Trial 47 finished with value: 84.84 and parameters: {'num_rbm_epochs': 5, 'batch_size': 379, 'rbm_lr': 0.06944476347888391, 'rbm_hidden': 7438, 'fnn_hidden': 244, 'fnn_lr': 0.002142868465968344, 'num_classifier_epochs': 5}. Best is trial 45 with value: 86.77.
[I 2025-03-16 10:50:37,448] Trial 48 finished with value: 83.88 and parameters: {'num_rbm_epochs': 5, 'batch_size': 252, 'rbm_lr': 0.079654431761058, 'rbm_hidden': 7811, 'fnn_hidden': 198, 'fnn_lr': 0.002309869969990883, 'num_classifier_epochs': 5}. Best is trial 45 with value: 86.77.
[I 2025-03-16 10:51:14,701] Trial 49 finished with value: 84.89 and parameters: {'num_rbm_epochs': 5, 'batch_size': 667, 'rbm_lr': 0.064477406468612, 'rbm_hidden': 7341, 'fnn_hidden': 208, 'fnn_lr': 0.001921665219518418, 'num_classifier_epochs': 5}. Best is trial 45 with value: 86.77.